System and Method for Facilitating Installation and Configuration of Network Devices

ABSTRACT

A mobile application for facilitating configuration and installation of networking and extender devices in a local area network utilizes augmented reality to provide configuration guidance information and network information. For configuring the networking device, a camera of the mobile computing device captures an image depicting the networking device, which is displayed on a touchscreen display of the mobile computing device with graphical elements including icons and textual information overlaid on the image to indicate configuration guidance information. Similarly, for installing the extender device, the camera captures image data depicting areas of the premises where the device is being installed and graphical elements are overlaid on the image data indicating network information such as the position of a previously installed networking device as well as the signal strength of wireless signals from the networking device.

RELATED APPLICATIONS

This application claims the benefit under 35 USC 119(e) of U.S.Provisional Application No. 62/653,072, filed on Apr. 5, 2018, which isincorporated herein by reference in its entirety.

BACKGROUND OF THE INVENTION

Consumer or small business grade networking devices are commonlyinstalled on user premises to support local area networks (LAN). Often,these networking devices are commodity devices that are provided by aninternet service provider (ISP) as part of an internet subscriptionservice. In other cases, consumers directly purchase devices to serve asrouters and wireless access points. Typically, these devices performrouter functions such as forwarding data packets between computernetworks such as the LAN for the premises and the service providernetworks, which provides access to the internet. Often, these networkingdevices include Wi-Fi capability, which is wireless local areanetworking (LAN) based on the IEEE (Institute of Electrical andElectronics Engineers) 802.11 standards. They also maintain the localnetwork and perform functions such as Dynamic Host ConfigurationProtocol (DHCP) services, domain name system (DNS) services,point-to-point protocol over Ethernet (PPPoE) services, network addresstranslation NAT) services, provide encryption such as WPA2, and afirewall, among other things.

Networking devices that include Wi-Fi capability maintain a wirelesslocal area network (WLAN) by linking computing devices using wirelesscommunication with each other and/or with the internet. The networkingdevices communicate with the computing devices by broadcasting andreceiving wireless signals, such as radiofrequency (RF) signals, to andfrom the computing devices in the vicinity of the networking device. Thewireless signals are typically in either a 2.4 GHz frequency range or a5 GHz frequency range, and simultaneous operation in both ranges is acommon feature of these networking devices.

The strength of wireless signals refers to the power present in wirelesssignals received by a device. In general, the strength of wirelesssignals decreases as the distance between two communicating devicesincreases. However, there are other factors affecting signal strength.Features of the premises such as the layout and/or composition of wallssituated between the two devices, or the presence of metal appliances inthe vicinity of either device, can decrease the signal strength.Additionally, wireless signals in the 5 GHz frequency range are lessable to penetrate solid objects than those in the 2.4 GHz range. All ofthese considerations result in networking devices effectively having acoverage area, or a set of areas of the premises for which wirelesscommunication with the networking device is possible. The coverage areaof even identical networking devices can vary based on the differentpremises in which the devices operate and even the installation locationwithin the same premises.

Extender devices have been developed to maximize the coverage area forWLANs managed by networking devices by providing a link between thenetworking devices and computing devices that may be located outside orat the periphery of the coverage areas of the networking devices. Ingeneral, an extender device is installed within the coverage area of anetworking device and re-broadcasts wireless signals to and from thenetworking device.

At the same time, mobile computing devices such as smartphones ortablets have become somewhat ubiquitous in both consumer and businesssettings. These devices are typically equipped with cameras forcapturing still images and/or video image data and sensors likeaccelerometers, magnetometers, and gyroscopes. Among other functions,operating systems (OS) as well as different mobile applicationsexecuting on the mobile computing devices render graphical userinterfaces (GUI) on touchscreen displays of the devices. The GUIs caninclude graphical elements such as icons, virtual buttons, menus,textual information and images. Users of the mobile computing devicesinteract with the GUIs by, for example, touching regions of the displaycontaining the graphical elements.

The field of computer vision includes various methods for processingstill images and/or video image data to extract meaningful information.These involve object recognition for categorizing or identifying objectsbased on previously learned objects, motion tracking, and featuredetection, for identifying edges, corners, ridges and other regions ofinterest in the image data. In many cases, sensor data such as thatgenerated by the sensors of a mobile computing device, can be used tofurther process the image data. Computer vision methods can be used torecognize objects, resolve the orientation (for example, of the mobilecomputing device capturing the image data), and recognize features suchas floors, walls, and other surfaces visible in the image data.

Augmented reality is an emerging technology that utilizes computervision methods to augment real-time image data with additionalperceptual information. For example, in many of these systems, text andgraphical elements such as icons are overlaid on real-time image data ofa surrounding environment in order to provide information about thesurroundings as well as provide an interface for interaction between thesystems and their users. Commonly, augmented reality experiences areprovided via touchscreen displays of mobile computing devices, which,for example, can be placed in the user's field of vision tosimultaneously capture image data from the user's field of vision via acamera, as well as display the image data along with overlaidinformation.

SUMMARY OF THE INVENTION

Networking devices and extender devices are typically installed by usersthemselves, for example, in their homes. Nonetheless, the process canpresent challenges to many users. For example, users that lack basicknowledge of networking technology might find configuring a newnetworking device difficult. In another example, users installingextender devices may be inclined to install the extender device in alocation where they have a weak signal, which would result in a weakconnection between the extender device and the networking device,defeating the purpose of the extender device. These challenges are oftenhard to troubleshoot and resolve over the phone, but sending techniciansis costly. A system would be desirable that can facilitate installationand configuration of these devices by providing information andassistance without requiring the participation of a technician, eitherin person or over the phone. In general, the present invention utilizesaugmented reality to overlay this information and assistance on capturedimage data from the individual users' surroundings.

In one example, a mobile application executing on a mobile computingdevice takes a captured image depicting the networking device, detectsfeatures of the networking device such as its display and/or physicalinterface, and overlays a virtual diagram on top of the image of theuser's networking device, showing the user where different cables shouldbe inserted.

In another example, the mobile application guides users to the exactspots in their homes for ideal signal propagation by taking capturedimage data depicting the potential areas where the extender device wouldbe installed (for example, different rooms of a home), detectingfeatures of the areas, and overlaying information about the network onthe image data. This network information can include the position of thenetworking device to which the extender will connect as well as virtualsignal rings drawn on the floors representing the signal strength in thedepicted locations. In this example, blue rings indicate that the signalstrength at the specified location is good enough for installing theextender device, while red rings indicate that the signal strength isnot good enough for installing the extender device. Additionalinformation, such as the pairing status of the networking device and theextender device, is also displayed.

In general, according to one aspect, the invention features a method forfacilitating configuration of a networking device using a mobilecomputing device. Image data depicting the networking device is capturedand processed to recognize features of the depicted networking device.Guidance for facilitating configuration of the networking device is thendisplayed based on the recognized features of the networking device.

In embodiments, the image data is processed by comparing the capturedimage data against reference images and/or models of the networkingdevice, and the image is processed in order to recognize specifically aphysical interface of the networking device.

Graphical elements indicating configuration guidance information aredisplayed in different positions with respect to the recognized featuresof the networking device. In one example (e.g. using a smart phone), thecaptured image data are rendered on a display of the mobile computingdevice with the graphical elements overlaid on the image data indifferent positions with respect to regions of the image datacorresponding to the recognized features of the networking device. Inanother example (e.g. using augmented reality glasses), the graphicalelements are superimposed into a field of view of a user in differentpositions with respect to visible features of the networking device inthe field of view of the user based on the captured image data and therecognized features of the networking device. These graphical elementscan be displayed in animation, and can represent cables to be pluggedinto an interface of the networking device, an electrical socket of apremises where the networking device is being installed, and/or portsfor other devices. Additionally, a configuration status of thenetworking device is determined.

In general, according to another aspect, the invention features a methodfor facilitating installation of an extender device in a wirelessnetwork of a premises using a mobile computing device. Image datadepicting areas of the premises is captured and processed to recognizefeatures of the depicted areas. Network information is then displayedbased on the recognized features of the areas of the premises.

In embodiments, the network information includes signal strengthinformation for the wireless network, configuration status informationfor the extender device and/or position information for previouslyinstalled devices of the wireless network, the position informationbeing generated based on previously installed devices recognized in theimage data.

Graphical elements indicating the network information are displayed indifferent positions with respect to the recognized features of the areasof the premises. In one example (e.g. using a smart phone), the capturedimage data is rendered on a display of the mobile computing device withthe graphical elements overlaid on the image data in different positionswith respect to regions of the image data corresponding to therecognized features of the depicted areas of the premises. In anotherexample (e.g. using augmented reality glasses), the graphical elementsare superimposed into a field of view of a user in different positionswith respect to visible features of the areas of the premises in thefield of view of the user based on the captured image data and therecognized features. The different positions of the graphical elementsare determined based on geometric information for the mobile computingdevice and the depicted areas of the premises, and recognized featuresof the premises. Visual characteristics of the graphical elements arealso based on the network information.

In general, according to another aspect, the invention features a systemfor facilitating configuration of a networking device. The systemcomprises a mobile computing device comprising a camera for capturingimage data depicting the networking device. A mobile applicationexecuting on a processor of the mobile computing device recognizesfeatures of the depicted networking device based on the captured imagedata, and a display presents guidance for facilitating configuration ofthe networking device based on the recognized features of the networkingdevice.

In general, according to another aspect, the invention features a systemfor facilitating installation of an extender device in a wirelessnetwork of a premises. The system comprises a mobile computing device,which comprises a camera for capturing image data depicting areas of thepremises. A mobile application executing on a processor of the mobilecomputing device recognizes features of the depicted areas of thepremises based on the captured image data, and a display presentsnetwork information based on the recognized features.

The above and other features of the invention including various noveldetails of construction and combinations of parts, and other advantages,will now be more particularly described with reference to theaccompanying drawings and pointed out in the claims. It will beunderstood that the particular method and device embodying the inventionare shown by way of illustration and not as a limitation of theinvention. The principles and features of this invention may be employedin various and numerous embodiments without departing from the scope ofthe invention.

BRIEF DESCRIPTION OF THE DRAWINGS

In the accompanying drawings, reference characters refer to the sameparts throughout the different views. The drawings are not necessarilyto scale; emphasis has instead been placed upon illustrating theprinciples of the invention. Of the drawings:

FIG. 1A is a schematic diagram illustrating an exemplary local areanetwork (LAN) to which the present invention is applicable;

FIG. 1B is a schematic diagram of the LAN according to an embodiment ofthe invention including augmented reality (AR) glasses worn by a user;

FIG. 1C is a schematic diagram of the LAN according to anotherembodiment in which the AR glasses operate in conjunction with aseparate mobile computing device;

FIG. 2 is a schematic diagram of a mobile computing device;

FIG. 3 is a perspective view of an exemplary premises, where anetworking device is to he configured and an extender device is to beinstalled;

FIG. 4 is a sequence diagram illustrating a process by which the mobileapplication facilitates configuration of the networking device accordingto the current invention;

FIG. 5 is an illustration of an exemplary menu screen of a graphicaluser interface (GUI), which is rendered on the touchscreen display ofthe mobile computing device;

FIG. 6 is an illustration of an exemplary device recognition screen ofthe GUI;

FIG. 7 is an illustration of the device recognition screen of the GUI,which is displayed after the networking device has been recognized inthe image data by a 3D model/image analytics module;

FIG. 8 is an illustration of an exemplary configuration guidance screenof the GUI;

FIG. 9 is an illustration of an iteration of the configuration guidancescreen displayed in an animation as a subsequent frame to theconfiguration guidance screen of FIG. 8;

FIG. 10 is an illustration of an iteration of the configuration guidancescreen displayed upon selection of a next button on the configurationguidance screen of FIG. 8 or 9;

FIG. 11 is an illustration of an iteration of the configuration guidancescreen displayed in an animation as a subsequent frame to theconfiguration guidance screen of FIG. 10;

FIG. 12 is an illustration of an iteration of the configuration guidancescreen displayed upon selection of a next button on the configurationguidance screens of FIG. 10 or 11;

FIG. 13 is an illustration of an iteration of the configuration guidancescreen displayed in an animation as a subsequent frame to theconfiguration guidance screen of FIG. 12;

FIG. 14 is an illustration of an iteration of the configuration guidancescreen displayed upon selection of a next button on the configurationguidance screen of FIG. 12 or 13;

FIG. 15 is an illustration of an iteration of the configuration guidancescreen displayed in an animation as a subsequent frame to theconfiguration guidance screen of FIG. 14;

FIG. 16 is an illustration of an exemplary configuration finished screenof the GUI;

FIG. 17 is a sequence diagram illustrating a process by which the mobileapplication facilitates the installation of the extender deviceaccording to the current invention;

FIG. 18 is an illustration of the menu screen showing the selection ofthe extender locater feature;

FIG. 19 is an illustration of an iteration of the device recognitionscreen displayed upon selection of an extender locater button on themenu screen;

FIG. 20 is an illustration of a subsequent iteration of the devicerecognition screen of FIG. 19 after the networking device has beenrecognized in the image data by the 3D model/image analytics module;

FIG. 21 is an illustration of an exemplary signal strength detectionscreen of the GUI;

FIG. 22 is an illustration of an exemplary signal strength resultsscreen of the GUI;

FIG. 23 is an illustration of an iteration of the signal strengthresults screen showing signal strength information for a second area ofthe premises;

FIG. 24 is an illustration of an iteration of the signal strengthresults screen showing signal strength information for a third area ofthe premises;

FIG. 25 is an illustration of an exemplary pairing screen of the GUI;and

FIG. 26 is an illustration of an iteration of the pairing screendisplayed after the pairing process is completed.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

The invention now will be described more fully hereinafter withreference to the accompanying drawings, in which illustrativeembodiments of the invention are shown. This invention may, however, beembodied in many different forms and should not be construed as limitedto the embodiments set forth herein; rather, these embodiments areprovided so that this disclosure will be thorough and complete, and willfully convey the scope of the invention to those skilled in the art.

As used herein, the term “and/or” includes any and all combinations ofone or more of the associated listed items. Further, the singular formsand the articles “a”, “an” and “the” are intended to include the pluralforms as well, unless expressly stated otherwise. It will be furtherunderstood that the terms: includes, comprises, including and/orcomprising, when used in this specification, specify the presence ofstated features, integers, steps, operations, elements, and/orcomponents, but do not preclude the presence or addition of one or moreother features, integers, steps, operations, elements, components,and/or groups thereof. Further, it will be understood that when anelement, including component or subsystem, is referred to and/or shownas being connected or coupled to another element, it can be directlyconnected or coupled to the other element or intervening elements may bepresent.

It will be understood that although terms such as “first” and “second”are used herein to describe various elements, these elements should notbe limited by these terms. These terms are only used to distinguish oneelement from another element. Thus, an element discussed below could betermed a second element, and similarly, a second element may be termed afirst element without departing from the teachings of the presentinvention.

Unless otherwise defined, all terms (including technical and scientificterms) used herein have the same meaning as commonly understood by oneof ordinary skill in the art to which this invention belongs. It will befurther understood that terms, such as those defined in commonly useddictionaries, should be interpreted as having a meaning that isconsistent with their meaning in the context of the relevant art andwill not be i an idealized or overly formal sense unless expressly sodefined herein.

FIG. 1A is a diagram illustrating an exemplary local area network (LAN)100 to which the present invention is applicable. In general, thecurrent invention includes a system and method for facilitating theinstallation and/or configuration of networking devices 110 and/orextender devices 115 in the LAN 100.

The LAN 100 includes a networking device 110, which is to be installedor has been previously installed at a premises 50 such as a home oroffice. The LAN 100 also includes an extender device 115 to beinstalled.

The networking device 110, which is an access point or router, supportsnetwork connections for host computing devices and maintains the LAN 100for the premises 50. In one embodiment, the device performs thetraditional functions associated with networking devices such asrouters. These include Dynamic Host Configuration Protocol (DHCP)services, domain name system (DNS) services, point-to-point protocolover Ethernet (PPPoE) services, network address translation (NAT)services, encryption such as WPA2, and firewall, among other things.

The networking device 110 includes a wired and/or wireless networkinterface 160. The wireless and/or wired network interface 160 connectsto an internet service provider wireless, cable or optical fiber modemor gateway and to host devices to provide connectivity between the hostdevices and to the internet. In one example, the interface includes aWi-Fi antenna and a Wi-Fi interface implemented in accordance with anyof the wireless local area network (WLAN) standards IEEE 802.11ac/n/g/b/a, in both the 2.4 GHz and 5.0 GHz frequency bands. In anotherexample, the interface also includes a wired data interface includingone or more gigabit Ethernet ports and/or RJ-45 jacks.

The extender device 115 provides a link between host devices and thenetworking device 110 by re-broadcasting wireless signals to and fromthe networking device 110 and the host devices. Ideally, the extenderdevice 115 is installed in a location within the premises 50 where thesignal strength allows reliable communication between the extenderdevice 115 and the networking device 110.

The extender device includes a wireless network interface 162, whichconnects to the networking device 110 and to host devices to provideconnectivity between the host devices and the networking device 110.Similar to the wired and/or wireless interface 160 of the networkingdevice 110 as previously described, the wireless network interface 162of the extender device includes a Wi-Fi antenna and a Wi-Fi interface.

At the premises 50, a user 105 operates a mobile computing device 120.The user 105 is the individual installing and/or configuring thenetworking device 110 and the extender device 115 and, in examples, is auser or a technician.

In the illustrated example, the mobile computing device 120 is asmartphone device. Alternatively, the mobile computing device 120 couldbe a laptop computer, tablet computer, phablet computer (i.e., a mobiledevice that is typically larger than a smart phone, but smaller than atablet), smart glasses, or augmented reality (AR) glasses, to list a fewexamples.

A mobile application 124 executing on the mobile computing device 120facilitates the installation and/or configuration of the networkingdevice 110 and the extender device 115 at the premises 50, in general,using data available to the mobile application 124 locally (such assensor data) and/or remotely.

The mobile application 124 communicates via a public network 114 (suchas the Internet) with a network management platform 102. The networkmanagement platform 102, which includes an application server 104,maintains network information for the LAN 100 as well as deviceinformation for the networking device 110 and the extender device 115including reference images and/or models of the devices. Thisinformation is stored, for example, in a database, and sent to themobile application 124 by the application server 104.

FIG. 1B is a diagram of the LAN 100 according to another embodiment ofthe invention. The system is similar to that described with respect toFIG. 1A. Now, however, the mobile computing device 120 is specifically aset of smart glasses 120-g worn by the user 105.

In one embodiment, the smart glasses 120-g include transparent lensesthrough which the user 105 views the surrounding environment, and thesmart glasses 120-g superimpose information onto the field of view ofthe user 105 using augmented reality (AR) technology. Commercialexamples of the smart glasses 120-g include the HoloLens® mixed realitysmart glasses, offered by Microsoft, and the Magic Leap One®head-mounted virtual retinal display device, offered by Magic Leap,among other examples.

in the illustrated embodiment, the smart glasses 120-g wirelesslyconnects to the LAN 100 and/or the public network 114 and executes themobile application 124 for facilitating the installation and/orconfiguration of the networking device 110 and the extender device 115,

In another embodiment, the smart glasses 120-g are a virtual realityheadset.

FIG. 1C is a diagram of the LAN 100 according to yet another embodimentof the invention. The system is similar to that described with respectto FIG. 1B. Now, however, the smart glasses 120-g wirelesslycommunicates with the smartphone mobile computing device 120 through awired or wireless communication link such as a Bluetooth link. In thisembodiment, the smartphone executes the mobile application 124 andconnects to the LAN 100 and public network 114, while the smart glasses120-g receive and display data fed to it by the smartphone.

FIG. 2 is a schematic diagram of the mobile computing device 120, whichcan be the smart phone or the smart glasses 120-g. The device includes aCPU 202, one or more displays 206, an accelerometer 228, a magnetometer230, a gyroscope 232, a global navigation satellite system (GNSS)receiver 216, a camera 236, a Wifi/WAN wireless network interface 214,and one or more antennas 226.

The CPU 202 executes firmware/operating system instructions and sendsinstructions and data to and receives data from the wireless networkinterface 214, the different sensors 228, 230, 232, the GNSS receiver234, the camera 236, and the display 206. Executing on typically anoperating system 204 of the CPU 202 are a mobile application 124, anetwork interface driver 210, which directs the functionality of theWiFi/WAN wireless network interface 214, and a display driver 212, whichdirects the functionality of the display 206, which, in examples, is atouchscreen display of a smart phone and/or a heads-up display of smartglasses 120-g, among other examples.

In general, the sensors 228, 230, 232, 234 detect movement of the mobilecomputing device 120 and generate sensor data. More specifically, theaccelerometer measures the acceleration of the mobile computing device120, the magnetometer 230 measures the rotation and orientation of themobile computing device 120 with respect to an ambient magnetic field,and the gyroscope 232 measures the angular velocity of the mobilecomputing device 120.

The GNSS receiver 234 receives positioning signals from GNSS satellites(such as GPS satellites) and sends positioning signals to the CPU 202,which uses them to generate location information, which is informationabout the current location of the mobile computing device 120.

The camera 236 captures images of the networking device 110 and/or anarea of the premises 50 (within the camera's 236 field of view) andgenerates image data depicting the networking device 110 or area.

in general, the wireless network interface 214 sends and receivesinformation between the mobile computing device 120 and the applicationserver 104 via the antenna 226 through a wireless communication link tothe WAN/LAN access point 116.

The mobile application 124 includes a graphical user interface (GUI)process 216, an augmented reality (AR) module 220, a 3D model/imageanalytics module 222, and a signal strength module 224. In general, themobile application 124 presents via the display 206 recognizes thenetworking device 110 and the extender device 115, features of thedevices, and/or features of areas of the premises 50 depicted in imagedata captured by the camera 236.

In general, the GUI process 216 renders a GUI 208 on the display 206.The GUI 208 includes a series of screens or views for displayinginformation and/or receiving input from the user 105, for example, bydetecting contact between the user 105 and the touchscreen display 206in certain regions of the touchscreen display 206. The GUI process 216generates graphical elements (such as icons, virtual buttons, menus,textual information) to be displayed via the GUI 208 and/or receivesuser input indicating selections of options represented by the graphicalelements of the GUI 208.

More specifically, the GUI process 216 receives captured image datadepicting the networking device 110 and/or the area of the premises 50.The GUI process 216 also receives icon position information indicatingpositions for graphical elements to be displayed with respect torecognized features of the networking device 110 and/or the area of thepremises 50. In one example, the GUI process 216 displays the capturedimage data itself (e.g. by rendering the image data on a touchscreendisplay 206 of a smart phone) along with graphical elements overlaid onthe captured image data in different positions with respect to regionsof the image data corresponding to the recognized features of thenetworking device 110 and/or area of the premises 50, based on the iconposition information. In another example (e.g. using the smart glasses120-g), the GUI process 216 superimposes the graphical elements into thefield of view of the user 105 in different positions with respect tovisible features of the networking device 110 and/or area of thepremises 50, based on the captured image data and the recognizedfeatures.

In general, the 3D model/image analytics module 222 receives image datagenerated by the camera 236 and generates position information forobjects and/or features recognized in the image data. The positioninformation associates different recognized objects with positions (suchas coordinates) with respect to the image data. The objects and/orfeatures can be recognized according to object recognition methods orother methods associated with machine vision, including, for example,comparing the image data to reference images and/or models of differentobjects. In different examples, the 3D model/image analytics module 222recognizes in the image data the networking device 110 (including, forexample, specific features of a physical interface of the deviceincluding data and/or power ports), the extender device 115, groundplanes, floors, walls, and windows, among other examples.

The signal strength module 224 detects wireless signals from thenetworking device 110 via the WiFi/WAN wireless network interface 214and generates signal strength information.

The AR module 220 generates icon position information for graphicalelements to be displayed on the GUI 208. The icon position informationrepresents visual characteristics and/or positions of the graphicalelements with respect to the image data itself or with respect to thefield of view of the user 105. The graphical elements representrecognized objects and/or indicate information such as configurationguidance information and/or network information such as signal strengthinformation. The icon position information is generated based on theobject position information generated by the 3D model/image analyticsmodule 222, the signal strength information generated by the signalstrength module 224, and other information such as status informationfor the LAN 100 and/or instructional information, both of which can beprovided by the application server 104. Additionally, the icon positioninformation is generated based on geometric information for the mobilecomputing device 120 and the surrounding area. In general, the geometricinformation is generated from processing the image data depicting thesurrounding area as well as sensor data generated by sensors of themobile computing device 120. The geometric information can includeposition information for recognized features of the surrounding area,orientation information for the mobile computing device 120, and sizeinformation, among other examples. The orientation information, whichindicates the position and/or angular orientation of the mobilecomputing device 120 with respect to the surrounding area is in turnbased on sensor data such as that received from the accelerometer 228,magnetometer 230, and gyroscope 232. Other types of sensors can also beused to generate sensor data on which the geometric information isbased, including barometers, structured-light 3D scanners, and rangeimaging cameras, among other examples.

In one embodiment, the GUI 208 is rendered on a display 206 of the smartglasses 120-g exclusively or in addition to the touchscreen display 206(e.g. of a smart phone), as previously described with respect to FIGS.1B and 1C. The display 206 of the smart glasses 120-g includes anoptical head-mounted display, a transparent heads-up display and/or ARoverlay technology, capable of reflecting projected digital images aswell as allowing the user 105 to see through the lenses. For example,the smart glasses 120-g include transparent lenses through which theuser 105 directly views the networking device 110 and/or the areas ofthe premises 50, and the display 206 includes a projection system forprojecting information onto the lenses and into a visual field of theuser 105. The smart glasses 120-g also include one or more cameras 236,and the image data captured by the camera 236 corresponds with androughly depicts the surrounding area within a natural field of view ofthe user 105 (e.g. the same area visible through the transparent lensesof the glasses). Portions of the GM 208 are projected onto the lenses ofthe glasses in different positions corresponding to visible features ofthe surrounding area, based on the image data captured by the camera236. More specifically, the GUI process 216 projects the graphicalelements onto the lenses of the smart glasses 120-g via the projectionsystem of the display 206 such that the graphical elements are overlaidon the natural field of view of the user 105 in different positionsbased on the icon position information generated by the AR module 220.One or more sensors, including the accelerometer 228, magnetometer 230,gyroscope 232, and/or GLASS receiver 234 are incorporated into the smartglasses 120-g, for example, to detect the movement and orientation ofthe user 105 wearing the smart glasses

In one example, the smart glasses 120-g incorporating the display 206work in conjunction with a separate mobile computing device 120, aspreviously described with respect to FIG. 1C. For example, the sensors228, 230, 232, 234 and camera 236 on the glasses generate the sensordata and image data, which are sent to the smartphone mobile computingdevice 120 to be processed by the GUI process 216, AR module 220, 3Dmodule/image analytics module 222, and/or signal strength moduleexecuting on the CPU 202 of the smartphone mobile computing device 120.The smartphone feeds the icon position information to the smart glasses120-g along with any other information necessary for projecting the GUI208 onto the lenses.

In another example, the entirety of the mobile computing device 120,including the components illustrated in FIG. 2, are integrated into thesmart glasses 120-g to form a single physical unit, as depicted in FIG.1B.

FIG. 3 is a perspective view of an exemplary premises 50, where anetworking device 110 is to be configured and an extender device 115 isto be installed. In the illustrated example, the premises 50 is a homeor apartment, and the user 105 is configuring the networking device 110and installing the extender device 105. The user 105 uses the mobilecomputing device 120 to capture an image of the physical interface ofthe networking device 110. The mobile application 124 detects featuresof the interface and overlays configuration instructions for the user105. To install the extender device 115, the user 105 uses the mobilecomputing device 120 to capture image data depicting the premises 50,including areas surrounding the networking device 110 and potentialinstallation locations for the extender device 115. The mobileapplication 124 detects features of the premises, including thenetworking device 110, in the image data and overlays networkinformation on the image data, including position information for thenetworking device 110, signal strength information, and configurationstatus information, which in turn facilitates the process of determiningan optimal location for the extender device 115.

FIG. 4 is a sequence diagram illustrating the process by which themobile application 124 facilitates configuration of the networkingdevice 110 according to the current invention.

In step 400, the GUI process 216 displays a menu for the user 105 andreceives a selection for the configuration assistance feature of themobile application 124 in step 402 via the GUI 208 rendered on thetouchscreen display 206.

In step 404, the GUI process 216 sends instructions to the 3Dmodel/image analytics module 222 to activate.

In step 406, the 3D model/image analytics module 222 receives image datafrom the camera 236 and generates a device interface image, which is astill image depicting the physical network and power interface of thenetworking device 110. The 3D model/image analytics module 222 alsogenerates position information for recognized features of the physicalnetwork and power interface (such as data and/or power ports) withrespect to the interface image (e.g, via object recognition and/orcomparing image data to a reference image and/or a model of thenetworking device 110).

In step 408, the 3D model/image analytics module 222 sends the interfaceimage and the position information to the GUI process 216.

In step 410, the GUI process 216 displays the interface image withgraphical elements indicating configuration instructions overlaid on theinterface image based on the position information for the recognizedfeatures and predetermined configuration instructions for the networkingdevice 110.

FIGS. 5-16 and 18-26 are illustrations of exemplary screens or views ofthe GUI 208. In general, the screens/views include graphical elementssuch as icons, virtual buttons, textual information, and menus forpresenting information and/or receiving input from the user 105.Selection of the virtual buttons, for example, is indicated by thetouchscreen display 206 detecting contact (for example, from the user's105 finger) in regions of the touchscreen display 206 containing thevirtual buttons. Other input is indicated by the touchscreen display 206detecting other gestures such as dragging or swiping.

In one example, the illustrations of FIGS. 5-16 and 18-26 depict screensthat are rendered on the touchscreen display 206 of the mobile computingdevice 120 during the installation and configuration process. In thiscase, in general, the screens include captured image data depicting thesurrounding environment (e.g. a networking device, an area of thepremises 50) in the background, and the GUI 208 includes the graphicalelements overlaid on the background image data.

In another example, the illustrations of FIGS. 5-16 and 18-26 depictdifferent views through lenses of the smart glasses 120-g. Here, thefield of view of the user 105 is analogous to the background image datarendered on the touchscreen display 206 in the previous example. Insteadof, or in addition to, viewing the depiction of the surrounding arearendered on the display 206, the user 105 directly views the surroundingenvironment through the lenses of the smart glasses 120-g, and the GUI208 includes the graphical elements superimposed or projected into thefield of view of the user 105.

FIG. 5 is an illustration of an exemplary menu screen 600-1 showing theselection of the configuration assistance feature from step 402. Themenu screen 600-1 includes a configuration assistance button 602, anextender position locator button 604 and a contact technical support 606button. In the illustrated example, the configuration assistance button602 is selected.

FIG. 6 is an illustration of an exemplary device recognition screen700-1, which is displayed when the configuration assistance button 602-1is selected on the menu screen 600-1. The device recognition screen 700includes a background the spans the entire area of the screen andincludes real time captured image data depicting the area, for example,of the premises 50, that is currently in the field of vision of thecamera 236. In practice, the image data would depict the networkingdevice 110 as it does in the illustrated example, as the user 105 wouldbe pointing the mobile computing device 120 at the networking device110. Overlaid on the image data background is textual informationindicating that the mobile application 124 is in the process ofrecognizing the networking device 110 as well as instructional text forthe user 105 to properly orient the mobile computing device 120 and thenetworking device 110 with respect to each other in order to recognize,more specifically, the physical interface of the networking device 110.To this end, the device recognition screen 700 also includes a devicetargeting region 702, which is outlined in the illustrated example by abox with dashed lines around its perimeter. The instructional textprompts the user 105 to position the networking device 110 such that adepiction of the physical interface of the networking device 110 iscontained within the device targeting region 702.

FIG. 7 is an illustration of the device recognition screen 700-2 afterthe networking device 110 has been recognized in the image data by the3D model/image analytics module 222. Now, the image data backgrounddepicts the physical interface of the networking device 110, and theinformational text indicates that the device has been recognized.

FIG. 8 is an illustration of an exemplary configuration guidance screen800, which is displayed after a device interface image 802 has beengenerated by the 3D model/image analytics module 222 in step 406. Ingeneral, the configuration guidance screen 800 displays guidance forfacilitating configuration of the networking device 110 based on thenetworking device 110 recognized in the image data. More specifically,the configuration guidance screen 800 includes a background that spansthe entire area of the screen and includes a device interface image 802,which, in the illustrated example, is a still image of the physicalinterface of the networking device 110 that was captured via the camera236 of the mobile computing device 120. Overlaid on the device interfaceimage 802 are graphical elements 808 indicating configuration guidanceinformation in different positions with respect to the device interfaceimage 802. The graphical elements indicate configuration guidanceinformation by, for example, graphically depicting different steps forthe user 105 to take to configure the device. These graphical elements808 can be displayed in animation and/or can include directional arrowsto more specifically guide the different steps of the configurationprocess.

The configuration guidance screen 800 also includes a previous button804 and a next button 806, for navigating to previous or subsequentsteps in the configuration process. Selection of these buttons 804, 806changes the graphical elements 808 overlaid on the device interfaceimage 802 based on which step is being depicted.

Finally, the configuration guidance screen 800 includes instructionaltext that generally corresponds to the step and to the actions depictedvia the graphical elements 808.

In the illustrated example, configuration guidance screen 800-1corresponds to a first step of the configuration process and includesgraphical elements 808-1 and 808-2. Graphical element 808-2 is agraphical representation of a power cable for the networking device 110.Graphical element 808-1 is an arrow shape pointing in a direction toindicate the action of plugging the power cable into a power port of thephysical interface. The instructional text instructs the user 105 toplug the power cable into the physical interface of the networkingdevice 110.

FIG. 9 is an illustration of the configuration guidance screen 800-2,which is displayed in an animation as a subsequent frame toconfiguration guidance screen 800-1. In the illustrated example,configuration guidance screen 800-2 still corresponds to the first stepof the configuration process and includes graphical elements 808-3-1,808-3-2 and 808-2. As before, graphical element 808-2 represents thepower cable. Now, however, the graphical element 808-2 has beenpositioned with respect to the device interface image 802 such that anend of the power cable aligns with an edge of the power port, and thevisual characteristics of the graphical element 808-2 have been changedsuch that a larger portion of the power cable is depicted, simulatingthe action of plugging the power cable into the power port. Graphicalelements 808-3-1 and 808-3-2 are arrow shapes pointing toward the powerport.

FIG. 10 is an illustration of the configuration guidance screen 800-3,which is displayed upon selection of the next button 806 on the previousiterations of the configuration guidance screen 800-1, 800-2. In theillustrated example, configuration guidance screen 800-3 corresponds toa second step of the configuration process and includes graphicalelements 808-2, 808-4 and 808-5. Graphical element 808-4 is a graphicalrepresentation of an electrical socket such as a wall socket of thepremises 50. As before, graphical element 808-2 represents the powercable. Now, however, the visual characteristics of the graphical element808-2 have been changed such that an even larger portion of the powercable is depicted, including a second end of the power cable, and thegraphical element 808-2 has been positioned with respect to the deviceinterface image 802 and graphical element 808-5 such that the first endof the power cable covers the power port depicted in the physicalinterface (indicating that end is plugged into the power port), and thesecond end of the power cable aligns with graphical element 808-4.Graphical element 808-5 is an arrow shape pointing in a direction toindicate the action of plugging the power cable into the electricalsocket. The instructional text instructs the user 105 to plug the powercable into the electrical socket.

FIG. 11 is an illustration of the configuration guidance screen 800-4,which is displayed in an animation as a subsequent frame toconfiguration guidance screen 800-3. In the illustrated example,configuration guidance screen 800-4 still corresponds to the second stepof the configuration process and includes graphical elements 808-6-1,808-6-2, 808-4 and 808-2. As before, graphical element 808-2 representsthe power cable, and graphical element 808-4 represents the electricalsocket. Now, however, graphical element 808-2 has been positioned withrespect to graphical element 808-4 such that the second end of the powercable partially covers the electrical socket, and the visualcharacteristics of graphical element 808-2 have been changed such that asmaller portion of the second end of the power cable is depicted,suggesting that the power cable has been partially inserted into theelectrical socket. Graphical elements 808-6-1 and 808-6-2 are arrowshapes pointing toward the electrical socket.

FIG. 12 is an illustration of the configuration guidance screen 800-5,which is displayed upon selection of the next button 806 on the previousiterations of the configuration guidance screen 800-3, 800-4. In theillustrated example, configuration guidance screen 800-5 corresponds toa third step of the configuration process and includes graphicalelements 808-2, 808-7 and 808-8. As before, graphical element 808-2represents the power cable. Graphical element 808-4 is a graphicalrepresentation of an electrical socket such as a wall socket of thepremises 50. Now, however, the visual characteristics of the graphicalelement 808-2 have been changed such that the second end of the powercable is no longer depicted. Graphical element 808-7 is a graphicalrepresentation of a network cable. Graphical element 808-8 is an arrowshape pointing in a direction to indicate the action of plugging thenetwork cable into a network port of the physical interface. Theinstructional text instructs the user 105 to plug the network cable intothe physical interface of the networking device 110.

FIG. 13 is an illustration of the configuration guidance screen 800-6,which is displayed in an animation as a subsequent frame toconfiguration guidance screen 800-5. In the illustrated example,configuration guidance screen 800-6 still corresponds to the third stepof the configuration process and includes graphical elements 808-2,808-7, 808-9-1, and 808-9-2. As before, graphical element 808-7represents the network cable. Now, however, the graphical element 808-7has been positioned with respect to the device interface image 802 suchthat an end of the network cable aligns with an edge of the networkport, and the visual characteristics of the graphical element 808-7 havebeen changed such that a larger portion of the network cable isdepicted, simulating the action of plugging the network cable into thenetwork port. Graphical elements 808-9-1 and 808-9-2 are arrow shapespointing toward the network port.

FIG. 14 is an illustration of the configuration guidance screen 800-7,which is displayed upon selection of the next button 806 on the previousiterations of the configuration guidance screen 800-5, 800-6. In theillustrated example, configuration guidance screen 800-7 corresponds toa fourth step of the configuration process and includes graphicalelements 808-2, 808-7, 808-10 and 808-11. Graphical element 808-10 is agraphical representation of a modem for connecting to the internet suchas a cable modem, the graphical representation including a depiction ofa network port of the modem. As before, graphical element 808-7represents the network cable. Now, however, the visual characteristicsof the graphical element 808-7 have been changed such that an evenlarger portion of the network cable is depicted, including a second endof the network cable, and the graphical element 808-7 has beenpositioned with respect to the device interface image 802 and graphicalelement 808-10 such that the first end of the network cable covers thenetwork port depicted in the physical interface (Indicating that end isplugged into the network port), and the second end of the network cablealigns with the network port depicted in graphical element 808-10.Graphical element 808-11 is an arrow shape pointing in a direction toindicate the action of plugging the network cable into the network portof the modem. The instructional text instructs the user 105 to plug thenetwork cable into the modem.

FIG. 15 is an illustration of the configuration guidance screen 800-8,which is displayed in an animation as a subsequent frame toconfiguration guidance screen 800-7. In the illustrated example,configuration guidance screen 800-8 still corresponds to the fourth stepof the configuration process and includes graphical elements 808-2,808-7, 808-10, 808-12-1, and 808-12-2. As before, graphical element808-7 represents the network cable, and graphical element 808-10represents the modem. Now, however, graphical element 808-7 has beenpositioned with respect to graphical element 808-10 such that the secondend of the network cable partially covers the network port of the modem,suggesting that the network cable has been inserted into the networkport of the modem. Graphical elements 808-12-1 and 808-12-2 are arrowshapes pointing toward the network port of the modem.

FIG. 16 is an illustration of an exemplary configuration finished screen1600, which is displayed upon selection of the next button 806 on theconfiguration guidance screen 800-7, 800-8. In general, theconfiguration finished screen 1600 displays confirmation that theconfiguration tutorial has concluded. Like the configuration guidancescreen 800, the configuration finished screen 1600 includes a backgroundthat spans the entire area of the screen and includes the deviceinterface image 802 as well as graphical elements 808-2 and 808-7representing the network cable and power cable. The configurationfinished screen 1600 also includes a support button 1602 andinformational text indicating that the configuration process isfinished.

FIG. 17 is a sequence diagram illustrating the process by which themobile application 124 facilitates the installation of the extenderdevice 115 according to the current invention.

In step 500, the GUI process 216 displays a menu for the user 105 andreceives a selection for the extender locater feature of the mobileapplication 124 in step 502 via the GUI 208 rendered on the touchscreendisplay 206 of the mobile computing device 120.

In step 503, the GUI process 216 sends instructions to the AR module 220activate the extender locater feature.

In step 504, the AR module 220 receives image data captured via thecamera 236 and sends it to the 3D model/image analytics module 222 instep 506.

In step 508, the 3D model/image analytics module 222 recognizes featuresof the image data, including objects depicted in the image data, such asthe networking device 110, the extender device 115, a ground plane forthe area depicted in the image, floors, windows and/or other objects(e.g. via object recognition and/or comparing image data to a referenceimage and/or a model of the networking device 110).

In step 510, the 3D model/image analytics module 222 sends positioninformation for the recognized features of or objects depicted in theimage data.

In step 512, the AR module 220 receives sensor data from the varioussensors of the mobile computing device 120 such as the accelerometer228, magnetometer 230, and gyroscope 232, and image data from thecamera. Based on the sensor data and image data, the AR module 220generates geometric information for the mobile computing device 120 andsurrounding area and calculates relative position information for therecognized objects based on the geometric information and the positioninformation for the recognized features and objects. In step 516, the ARmodule 220 then generates icon position information for the networkingdevice 110 (such as coordinates) with respect to the image data, basedon the relative position information for the networking device 110.

In step 518, the signal strength module 224 detects wireless signalsfrom the networking device 110 and generates signal strength informationfor the signals. The signal strength module 224 then sends the signalstrength information to the AR module 220 in step 520.

In step 521, the AR module 220 generates icon position information forsignal strength indicators based on the position information (forexample, for recognized floors depicted in the image data) and thesignal strength information as well as the geometric information for themobile computing device 120 and the surrounding area. The signalstrength indicators are graphical elements indicating the signalstrength for different areas of the premises 50 depicted in differentregions of the image data.

In step 522, the AR module 220 sends all of the generated icon positioninformation (for both the graphical elements representing objects suchas the networking device 110 and the signal strength indicators).

Finally, in step 524, the GUI process 216 displays the image data withgraphical elements overlaid on the image data based on the icon positioninformation, including, for example, icons representing the networkingdevice 110 and/or red or blue signal strength indicators.

FIG. 18 is an illustration of the menu screen 600-2 showing theselection of the extender locater feature from step 502. As before, themenu screen 600-2 includes the configuration assistance button 602, theextender position locator button 604 and the contact technical support606 button. In the illustrated example, the extender locater button 604is selected.

FIG. 19 is an illustration of the device recognition screen 700-2, whichis displayed when the extender locater button 604 is selected on themenu screen 600. Similar to the device recognition screen 700-1 for theconfiguration assistance feature, the device recognition screen 700-2includes a background that spans the entire area of the screen andincludes real time captured image data depicting the area, for example,of the premises 50, that is currently in the field of vision of thecamera 236. In practice, the image data would depict the areasurrounding the networking device 110, as the user 105 would be pointingthe mobile computing device 120 at the networking device 110,potentially from a distance such that a significant portion of thepremises 50 is depicted in the image data. Overlaid on the image databackground is textual information indicating that the mobile application124 is in the process of recognizing the networking device 110.

In the illustrated example, the area of the premises 50 depicted in thebackground image data of the device recognition screen 700-2 is a roomof a house or apartment, with a networking device 110 in one corner ofthe room.

FIG. 20 is an illustration of the device recognition screen 700-2 afterthe networking device 110 has been recognized in the image data by the3D model/image analytics module 222 in step 508. Now, a networkingdevice icon 2002 is included. The networking device icon 2002 is agraphical element representing the networking device 110. In theillustrated example, the networking device icon 2002 is a shapeindicating the region of the background image data in which thenetworking device 110 was recognized. Informational text indicates thatthe device has been recognized.

FIG. 21 is an illustration of an exemplary signal strength detectionscreen 2100, which is displayed while the signal strength module 224 isgenerating the signal strength information in step 518. Similar to thedevice recognition screen 700-2, the signal strength detection screen2100 includes a background that spans the entire area of the screen andincludes real time captured image data. Overlaid on the image databackground is textual information indicating that the mobile application124 is in the process of detecting the signal strength. The signalstrength detection screen 2100 also includes the graphical element 2002indicating the region of the background image data in which thenetworking device 110 was recognized.

FIG. 22 is an illustration of an exemplary signal strength resultsscreen 2200-1, which is displayed in step 524 after the signal strengthinformation has been generated. In general, the signal strength resultsscreen 2200 displays network information based on features and objectsrecognized in the image data. The signal strength results screen 2200includes an image data background similar to the signal strengthdetection screen 2100. Overlaid on the image data background are signalstrength indicators 2204, which are graphical elements that indicate thesignal strength information. The visual characteristics and positions ofthe signal strength indicators with respect to the background image dataare determined by the AR module 220 in step 521 and are based on thesignal strength information generated in step 518 and the positioninformation generated in step 508 for the recognized features in theimage data.

More specifically, the signal strength indicators 2204 are, in theory,graphical representations of evenly-spaced, concentric ring shapesencircling the projected location of the networking device 110 (which isbased on previous and/or real time recognition of the networking device110 in the background image data). The signal strength indicators 2204are overlaid only on the regions of the background image data containingdepictions of the ground plane, or floor of the premises 50, and onlythe portions of the concentric rings that overlap with the depictions ofthe floor are visible. In practice, the signal strength indicators 2204would commonly appear on the signal strength results screen 2200 asarcs, as walls and other recognized features of the premises 50 obscureportions of the rings.

Different colors of the signal strength indicators 2204 indicatedifferent signal strength levels. In one example, blue signal strengthindicators 2204-b indicate strong signals from the networking device110, while red signal strength indicators 2204-r indicate weak signalsfrom the networking device 110.

Further, in some examples different contour lines of the signal strengthindicators 2204 are provided for different WiFi bands such as differentindicators for each of the 2 GHz band (802.11b/g/n), 3.65 GHz band(802.11y), 5 GHz band (802.11a/h/j/n/ac/ax), 5.9 GHz band (802.11p), 60GHz band (802.11ad/ay). This allows the user to discriminate the signalstrength among the different bands.

In the illustrated example, the signal strength results screen 2200-1includes the same image data background as in the illustrated example ofthe signal strength detection screen, including the depiction of a roomof the premises 50 with the networking device 110 in the corner of theroom. The graphical element 2002 indicating the region of the backgroundimage data in which the networking device 110 was recognized is alsoincluded. The signal strength results screen 2200-1 also includes elevenblue signal strength indicators 2204-b-1 through 2204-b-11.

FIG. 23 is an illustration of the signal strength results screen 2200-2showing a different area of the premises 50 (for example, after mobilecomputing device 120 has been rotated or relocated to have a differentvantage point of the premises 50). For example, the user 105 (with themobile computing device 120) may have turned away from the networkingdevice 110 toward a nearby hallway of the premises 50 in order to beginsearching for a location to install the extender device 115. Thebackground image data now depicts a hallway of the premises 50 with fouradditional blue signal strength indicators 2204-b-12 through 2204-b-15,the shape of which indicates that the networking device 110 is locatedat a point in the opposite direction than the direction in which thecamera of the mobile computing device 120 is pointed.

FIG. 24 is an illustration of the signal strength results screen 2200-3showing yet another area of the premises 50. In this example, the user105 (with the mobile computing device 110) may have walked down the samehallway of the premises 50 as the one depicted in signal strengthresults screen 2200-2, entered a door at the end of the hallway andturned around to face the networking device 110. The background imagedata now depicts the hallway from a different perspective as well as aportion of a different room. Overlaid on the background image data isthe networking device icon 2002, which is now a graphical representationof the networking device 110. The position of the networking device icon2002 with respect to the image data is determined in step 516 based onthe geometric information for the mobile computing device 120 andsurrounding area generated in step 514 and the position information forthe recognized networking device 110 generated in step 508. Alsoincluded are three additional blue signal strength indicators 2204-b-19through 2204-b-21 and three red signal strength indicators 2204-r-1through 2204-r-3. Consistent with the position of the networking deviceicon 2002, the shape of the signal strength indicators 2204 suggeststhat the networking device 110 is located at a point further on in thesame direction as the direction in which the camera of the mobilecomputing device 120 is pointed (for example, in the area at theopposite end of the hallway, toward the right). Additionally, the bluesignal strength indicators 2204-b-19 through 2204-b-21 are overlaid onthe region of the image data depicting the floor of the hallway, whereasthe red signal strength indicators 2204-r-1 through 2204-r-3, indicatinga weaker signal strength, are overlaid on the region depicting a floorof a room at the end of the hallway, which would be located a furtherdistance away from the networking device 110 than the hallway.Instructional text instructs the user 105 to move closer to thenetworking device 110.

FIG. 25 is an illustration of an exemplary pairing screen 2500-1, whichis displayed after the pairing process for the networking device 110 andthe pairing device 115 is initiated. In general, the pairing screen 2500displays configuration status information for the extender device 115.The exemplary pairing screen 2500 includes the background image data aswell as the networking device icon 2002, an extender device icon 2502representing extender device 115, and a configuration status indicator2504-1 and informational text, both of which indicate the configurationstatus information.

In the illustrated example, the user 105 (with the mobile computingdevice 110) may have walked a few steps toward the door of the roomdepicted in the signal strength results screen 2200-3 to move closer tothe networking device 110. The extender device icon 2502 is a shapeoverlaid on the background image data below the networking device icon2002. The configuration status indicator 2504-1 is a line connecting thetwo device icons 2002, 2502, indicating that the pairing process ispending, which is also indicated by the informational text.

FIG. 26 is an illustration of the pairing screen 2500-2, which isdisplayed after the pairing process for the networking device 110 andthe extender device 115 is completed. Here, the configuration statusindicator 2504-2 is an exclamation point symbol. Both the configurationstatus indicator 2504-2 and the informational text both indicate thatthe pairing process has completed.

While this invention has been particularly shown and described withreferences to preferred embodiments thereof, it will be understood bythose skilled in the art that various changes in form and details may bemade therein without departing from the scope of the inventionencompassed by the appended claims.

What is claimed is:
 1. A method for facilitating configuration of anetworking device using a mobile computing device, the methodcomprising: capturing image data depicting the networking device;recognizing features of the depicted networking device based on thecaptured image data; and displaying guidance for facilitatingconfiguration of the networking device based on the recognized featuresof the networking device.
 2. The method as claimed in claim 1, furthercomprising recognizing a physical interface of the networking devicebased on the image data.
 3. The method as claimed in claim 1, furthercomprising recognizing the features of the networking device bycomparing the captured image data against reference images and/or modelsof the networking device.
 4. The method as claimed in claim 1, furthercomprising displaying graphical elements in different positions withrespect to the recognized features of the networking device, thegraphical elements indicating configuration guidance information.
 5. Themethod as claimed in claim 4, further comprising rendering the capturedimage data on a display of the mobile computing device with thegraphical elements overlaid on the image data in different positionswith respect to regions of the image data corresponding to therecognized features of the networking device.
 6. The method as claimedin claim 4, further comprising superimposing the graphical elements intoa field of view of a user in different positions with respect to visiblefeatures of the networking device in the field of view of the user basedon the captured image data and the recognized features of the networkingdevice.
 7. The method as claimed in claim 4, further comprisingdisplaying the graphical elements in animation.
 8. The method as claimedin claim 4, further comprising the graphical elements representingcables to be plugged into an interface of the networking device, anelectrical socket of a premises where the networking device is beinginstalled, and/or ports for other devices.
 9. The method as claimed inclaim 1, further comprising determining a configuration status of thenetworking device.
 10. A method for facilitating installation of anextender device in a wireless network of a premises using a mobilecomputing device, the method comprising: capturing image data depictingareas of the premises; recognizing features of the areas of the premisesbased on the captured image data; and displaying network informationbased on the recognized features.
 11. The method as claimed in claim 10,wherein the network information includes signal strength information forthe wireless network.
 12. The method as claimed in claim 10, wherein thenetwork information includes position information for previouslyinstalled devices of the wireless network.
 13. The method as claimed inclaim 12, further comprising generating the position information basedon previously installed devices recognized in the image data.
 14. Themethod as claimed in claim 10, wherein the network information includesconfiguration status information for the extender device.
 15. The methodas claimed in claim 10, further comprising displaying graphical elementsin different positions with respect to the recognized features of theareas of the premises, the graphical elements indicating the networkinformation.
 16. The method as claimed in claim 15, further comprisingrendering the captured image data depicting the areas of the premises ona display of the mobile computing device with the graphical elementsoverlaid on the image data in different positions with respect toregions of the image data corresponding to the recognized features ofthe depicted areas of the premises.
 17. The method as claimed in claim15, further comprising superimposing the graphical elements into a fieldof view of a user in different positions with respect to visiblefeatures of the areas of the premises in the field of view of the userbased on the captured image data and the recognized features of thepremises.
 18. The method as claimed in claim 15, further comprisingdetermining the different positions of the graphical elements withrespect to the recognized features of the premises based on geometricinformation for the mobile computing device and the depicted areas ofthe premises.
 19. The method as claimed in claim 15, wherein visualcharacteristics of the graphical elements are based on the networkinformation.
 20. A system for facilitating configuration of a networkingdevice, the system comprising: a mobile computing device comprising acamera for capturing image data depicting the networking device, aprocessor for executing a mobile application for recognizing features ofthe depicted networking device based on the captured image data and adisplay for presenting guidance for facilitating configuration of thenetworking device based on the recognized features of the networkingdevice.
 21. The system as claimed in claim 20, wherein the mobileapplication recognizes a physical interface of the networking device.22. The system as claimed in claim 20, wherein the mobile applicationrecognizes the features of the networking device by comparing thecaptured image data against reference images and/or models of thenetworking device.
 23. The system as claimed in claim 20, wherein thedisplay presents graphical elements in different positions with respectto the recognized features of the networking device, the graphicalelements indicating configuration guidance information.
 24. The systemas claimed in claim 23, wherein the mobile application renders thecaptured image data on the display with the graphical elements overlaidon the image data in different positions with respect to regions of theimage data corresponding to the recognized features of the networkingdevice.
 25. The system as claimed in claim 23, wherein the mobileapplication superimposes the graphical elements into a field of view ofa user via the display in different positions with respect to visiblefeatures of the networking device in the field of view of the user basedon the captured image data and the recognized features of the networkingdevice.
 26. The system as claimed in claim 23, wherein the graphical edisplayed in animation.
 27. The system as claimed in claim 23, whereinthe graphical elements represent cables to be plugged into an interfaceof the networking device, an electrical socket of a premises where thenetworking device is being installed, and/or ports for other devices.28. The system as claimed in claim 23, wherein configuration status ofthe networking device is determined.
 29. A system for facilitatinginstallation of an extender device in a wireless network of a premises,the system comprising: a mobile computing device comprising a camera forcapturing image data depicting areas of the premises and a processor forexecuting a mobile application for recognizing features of the areas ofthe premises based on the captured image data and a display forpresenting network information based on the recognized features.
 30. Thesystem as claimed in claim 29, wherein the network information includessignal strength information for the wireless network.
 31. The system asclaimed in claim 29, wherein the network information includes positioninformation for previously installed devices of the wireless network.32. The system as claimed in claim 31, wherein the position informationis generated based on previously installed devices recognized in theimage data.
 33. The system as claimed in claim 29, wherein the networkinformation includes configuration status information for the extenderdevice.
 34. The system as claimed in claim 29, wherein the displaypresents graphical elements in different positions with respect to therecognized features of the areas of the premises, the graphical elementsindicating the network information.
 35. The system as claimed in claim34, wherein the mobile application renders the captured image data onthe display with the graphical elements overlaid on the image data indifferent positions with respect to regions of the image datacorresponding to the recognized features of the premises.
 36. The systemas claimed in claim 34, wherein the mobile application superimposes thegraphical elements into a field of view of a user via the display indifferent positions with respect to visible features of the areas of thepremises in the field of view of the user based on the captured imagedata and the recognized features of the premises.
 37. The system asclaimed in claim 34, wherein the different positions of the graphicalelements with respect to the recognized features of the premises arebased on geometric information for the mobile computing device and thedepicted areas of the premises.
 38. The system as claimed in claim 34,wherein visual characteristics of the graphical elements are based onthe network information.